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ABS.TRACT 

^ . The role of educational evaluation is discussed. in 

relation to interdisciplinary courses in soc4.al science, &oiw one 
evaluates student, achievement , a course or an instructor cfan be 
defined by means of defining behavioral objective^. That iis, 'the 
ejtpressed outcomes of the particular course can be expressed as the 
goals tp be met by students and on the courses iieing taken or taught, 
some* suggestions are given to aid in establishing these behavior 
goals^ It is suggested that the use of these behavior ally de'fined \^ 
objectives will develop a more independent learning^and thinking 
student^ as well as enhance the .value of stud^t achievement^ 
cur^icular design and inistructional skill, (DEP) . v 
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' EVALUATION AND THE SOCIAL .SCIENCE INTERDISCIPLINARY COURSE 



' . - by 



James Steve Counelis^ 



Classic Questions : 



The te<m "etvaluation" is the name for any process through 
which "values," "worth," "preferabilit/," "des.lreability," "utility,"' 

, ■ . - ^ . - . 

and any Other merit is assigned to some object or person. The whole of . 
axiology'is involved, ranging from folk wisdom, jurisprudence, ethics I - 
and morality, through all types of aesthetic judgments,, to statistical 
tJecision >theory, systems of dptimizing equations and game. theory. 
Though the processes of evaluation appearfto be a very large set, cer- 
tainly the objects and persons being valued are an infinite set. ' 

The class of questions undertaken Jn this paper are the clas-t 
sical ones, these being concerned with the course and/oV lesson level 
of curriculum. How are courses or lessons 'merited?- ^ what criterion . 
or standard is a course or lesson to be valued? How are instructors 
judged? By what criteria or^ standards are they to be val*ued? How is - 
student achieventent valued? By what criterion or standard is achieve- 
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ment estimated?. The purpose of this paper is to. present some general 
principles governing Sirch activities, in. order thfiit such an o&vi.dusly ego 
involved process as evaluation can become more objective, more rational, 
more humane in effect. * \ 

The Phenomenology of Valuing in the Educating Experience : 

^ Simplistically stated, instruction in all formal, ^informal 
or casual formats Is a "show-and-tell" process. .Reciprocally, learning 
is known to have occurred by the student's replicated or aped behavior 
of what he has been shown and told. ' Though this objective phenomenolog- 
ical view of the teaching/learning intersect may fdrce learning theo-. 
rtsts and humanists alike to climb a wall, the lar^e measure of common- 
sense in this simplistic model of the teaching/learning intersect will 
serve""-^ purpd§es of this paper. * 

^ That which links instructor to student. is called, generical- 
ly, curriculum. It could",be;a whole two year R*N. program ih a com- , 
prehensive community college, a single graduate seniinar in social theo- 
ries of change, or a particular lesson in welding, the pronunciation- of 
new words, or the use of chiaroscuro technique in painting. Whatever 
the level of curriculum or the subject matter ar^a, '^curriculum has a Vin 
^ar perspectfval qualUy given to by^those' who view it through the 
roles of instructor 'and learner. Each person in these roles is ego- 
involved. Further, .the. role perspective on curricu'luir is tied with the 
inter-sub.jective relations of persons thH lace personaT worth as self- 



image, concerhS;^> and interests together. These inter-subjective feel- 
ings are perfectly natural and generally healthy facts. The problem of . 
evaluation, though, is complicated by these yelry human facts". 

Generkaliy when the instr-uctor functions in an evaluating - 
role, he does so by viewing the learner through the phenomenOTogical 
prism of jTiS 'Curriculujti which includes his testing methodology. Like- 
wise, the student' fuctions in an evaluating role by viewing the ^prof e^sor 
through the phenomenolpgifcar prism of his experienced curriculum which 
includes' his meriting methodQlogy." Chaft No. 1 cites a graphic presen- 
tation of this linear prpiective model 6f educational evaluation, based 
upon the above phenomenologi cat facts. It is quite obvious that the in- 
'structor's "cu^iculum"- anii the. s "curriculum" are not identical 

facts. Nor are their criteria or standards' for judgment identical. Aye, 
there is the rubl Hence the; phenomenologi cal facts described by the 
linear projective model of educational evaluation provides the source 
of , contamination in most educcitional situations, be it in the home, at 
work, or in the school- v 

Cinser^t' Chart No. 1 Here.] ' 




Educational Evaluation in OrthoaOT^ ^ 

The objective phenorrienal facts about- educational evaluation 
as subjective process lead more often; than not to bad human rel-ations, 
bad pedagogy, ^ind^to'a derelictlfi^n of the e processes, if there 

are no ccnstious constructive cQdnteractions to the d^istructive potential 



of subjective- evaluational processes. The instructor as evaluator , 
always in an ego- involved role. Anjf challenge to instructor's eval- 
uation reflecting upon relevance, competence, adequacy of criteria, an,d/ 
or equity is viewed personally as an attack upoQ^liim. Likewise, the 
Studer\t as the evaluatee is occupying an ego- involved role. 'Evaluation 
is ajlj/ays' a challenge to his competence, integrity, and self-imap. The 
.power position of the instructor to assign grades, to affect personal 
well being, and dignity, and to affect further goals and progress is 
well understood by both instructor and student. At 'most, the student 
must rely upon the goodwill and honor of the instructor to resi^ect and 
keep his fiducia.ry trust with his student client as a professional. In 

addition, the stucient involvement irpthe evaluation of particular in- 

' . ' i ' ' '— « j>'' ' ' » . 

structOrs redresses the power relation.at some gro^s level. And for 

those few instances of bad chemistrl between particular professors and 
' parti\cul'ar ^udents, student appeal through school administrative pro^- 
cesses usually handles such- matters q^iite equ-itably;, , But more impor- 
tantly, the' student evaluation of instructors when done welV provides 
valuable real ityr testing cyberneiic' information to the instructors * 
about themselves in their instructional relations with student clients. 

, ■ ■ , - . 

Permit°the introduction of the idea that botb„instructor 

\ . ^ , ^ . L 

.' and sttident need to/ assume the evaluator role from a different perspec- 
tive, one that might be described as righ^-angled or -orthogonal to their 
customarV projective 4 i near view. The orthogonal model of educational 
evaluation i\s suggested in Chart No. 2.. • This evaludtin~g*rol€ in orthog- 
onal peri^3ectfve .suggests a kind of "role detachment'' such. that instruc- 



ERIC 



tion and ^learning aire .viewed from a common external stgtus-role position 
^hich fociises through the curriculum, commonly understood. ' The curri'cu- 
lum, if containing objective instructional intents, behavi orally speci- 
fied learnings, and criteria, would be cauSe for both the instructor and 
student, the icommorf basis for evaluating their^own work in relation to 
each ather, ■ , ' 

\ ' [Irjsert Chart No • 2 'Here-] 

' . : • ■. • - ' ■ : 

• - ^ •! ■ ■ 

/ . ■% 

• ■ .. ( ■ . . ■ \ ■ 

Courses-taught by college and university professors usually 

do not possess such objectifying elements. Be they natural Scientists, 

behavioral scientists, or humanists, most college and university pro- - 

fessors do not think in these instructional tejrras. They tend to believe 

that their "scientific method" or their "disciplinary patterns and log-. 

ics" contain within them the appropriate pedagogical qualitites for in- 

s ■ ■ . ' ■• ■ . 
ducing student learning. . These disciplinary approaches to, education havte 

mi&h intuitive appeal to subject matter' specialists who use them in their 
own inquiries. However in tihe practical order, nothing is further from 
the truth. Effective teaching and effectiveH'earning are specific goal- 
seeking processes that have little resemblence to The results of pyre 
inquiry processes, which results are the encydlopaedic grist of disci- 
plines turned curriculum. Instruction as "show-and-tell" is a cofigeries 
of learning induction processes. Though that congeries includes the 

vomited liftture, the ad nauseam replicating laboraton and the shop th^t 

^ ft . > 

imitates work, clearly the variety of learning indiiCtTon processes go be- 
yond these formats. loathe absence of specific course "and lesson goals, 



specifiect behavioral learnings, and criteria known to both instructor . 
and student, the ofthogonal evaluation perspective factually collapses ■ 
into the projective linear model of educatipnal evaljua-tion with all of- . >' 



its attendent evils.** 



• ■.'■,- ■•>• 

The Phenomenology o^ Achievement and the Limits to Mensurable Standards ; 

^ . \ - . - • 

Within formal, informal, and casual learning situations, "the 
* fact of achievement is an objective yes/no observation. Achievement is^ ; 
noted when a "yes" can .be said to someone doing any of the- following^ ^ 
(1) solving simultaneous^equations; (2) cooking .Chicken'Kiev;. (3), - 
doing a pirouette; (4) swimming the Engl ish'Channel in..reccfrd time; . ^ - 

(5) speaking modern Greek fluently; (6) reciting the' Browning monologue ^ 

^ '■ * -• 

' , "^^y Last Duchess"; (7) composing a sonata; .(8)= repairing a fV set;' (9) 

knowing the literature ^n the American Revolution at the doc,t(|ral level; : 

(10) knitting Argyll socks! All of -these achievements are efiiftirically • 

verifiable and therefore phenomenally objective. Thus Simon Bine t age-; 

graded tasks in developinga test of intelligence and the IQ ratio Of.inen- 

tal divided by chronological age. ^' - - 

\ ■ IfM . ■ . < . .■■Vi^>- 

»\ . For every cdurse taught regardless of level, the instructor 

^i si forced to select from an almost infinite, universe of possible' learn- 

i^l'^ a manageable subset for instruction and evaluation. A s,tandard ' ■ 

a||ses when the instructor constructs a set of achievement-deternfining ' 

lltuatiops in which the student r'fesponses become frequency<*counts of 

8i6ses. Achievement measurement is thus limited to tha ins true tpiK-deter- 



mined set qf leanings; and achievement becomes -objective some propor- 
tion of successes out of* the total set of instructor-determined teste'd 
learnings. x ^ ' * 

' • Whettt^ one evaluates a student teacher, or an .apprentipe 
printer, or the arithmfetic skills of a sixth grader, -or the quality, of. 
a poem or essay, achievement is known through objectifying observations 
and/or the consensus oi" plural observers." Performance and not intui- 
tion is the' basis for knowing specific learnings have occurred. . And 

1 * • ■ . • -- * . 

though every student learns many other things thatv^re not demonstrated . 

through th'e instructor-developed evaluation procedures, given clearly ^[.^^ 

. ' ' " ■ ' ^ - - ■ '0 

defined course objectives and behavioral ly specified learnings, t|he^^n^e0, 

elusion from the course evaluation is reasonable, for they weriB-n&t Qflt* 

ricularly intended, even though .important to the student.l Before' 



tering upon a description aiid process for specifying b^havioi-al objei^V^; . 

^ " • • - .. • ■ . '-H'ir 

tives, a^brief description of social science interdisciplinary courses?uf 

' ' ' . v - ■ ' 

se6ms appropriate at this point. - , fr-.i.''' 

^ ' : - V • - ■ 'Si 

Social Science Interdisoiplinary Course' Structures' :^ , * 

■ • . ■ ^ ' ' ".;Vi , 

» , When interdisciplinary courses are viewed at the.Jevel of ^ 

particulars, their number and variety appear legion. But when inter4l;' 

disciplinary courses are viewed at\the'level 6f 1^^^^^ their nutnbdih 

is a finite three.. Discipl-ine as knowledge {Jil'aHd discipline~a.$. the'' 
• ' . ' .-. f^. ' ' ' ■'" . 

"shaping of human behavior toward orderly self-corimlled conduct (b)^"' 

afe the two structural elements iji all interdiscii^lallary c^^^ the 

..thrge , types of interdisciplinary courses are: ^ v . .i'l 



V . Type I: n(i<oAk| ft.' / ..;Kri)i • ^ 

^ ' Type II r .ntboA'bi . . . .bn)i . ' ' 

Type III:. EtknAbn). ; " ' ' ' 

■ - . " ^ ■ *. " ' ' ' • ■ • - 

^heir descriptive meaning is" given below.* '>v 

In the social sciences, Type I interdisciplinary courses are 
reflected, in the following examples: (1) the social sciences, survey or 
problems course; (2) an ethnic studies course that has anthropological, 
Wstorical^ and artistic-literary dimensions, in som„e' integrated eombina- 
tion; (3) the sociology of polities or educatior/; (4) political econoftiy 
an.d tacro-econometric systems;' (5) Jfulturgeschithte in the fonii^f Jacob 
Burdkhardt's The Civilization of the Italian Renaissance , J. iluiziryja's- 
The jWanin^ bf:the Midcfle Ages > and William H. McNeill 's The Risg^of the ^ 
West: A Htstoy?y the Human Community; ^" (6) mathematical psychology 
dM so^^m^^\{J) social psycliology. .Type f ^interdisciplinary courses 
rapUalizfe on:the intersect of twtf or mare established branches of know- 
lec^'ge to attain their structure. ^ ^ ' » 

/ Type II interdisciplinary courses are^not-^new to the higher 

education scene either^ Thers*' are' many social sciences examples of this' 
type of course but the following" are a few: . (1) parliamentary procedure 
a'hd group decision-maki>ig^ (2) training. poT ice, industrial Supervisors, 
or principals 1ri human relations techniques;, ^(3) the good sportsmanship' 
fethic^^ varsity and professional sporls; (4) leadership, training; (5) 
, counselor and therapist training;^ (6) courses 1n personal adjustment and 
confidence tra-inilig;' (7)' meditational. skills. \ type II courses capitalize 



oh the ijitersect^ among particular behavioral shaping "sy lis, be these ° 
jcognitive, affective, psychomotor, or social i For specific listings of 
such skills, see 'the several taxonomies of educational objectives^ and 
Havighurst's little volume on develppmental tasks. ^ . , 

/ . ' • • • " 

sj. Type III interdisciplinary courses are coming into vogue, 
though these too hiive been around for some time^ Thes& courses ^re char- 
|icterized by the practical Intersect of a branch of knowledge and several 
behavioral shaping; ski lIsT The following, are examples of Type III courses: 

^(1) training doctors and nurses in the problems and techniques related 
to the psychology of dying; (2) the .training of risk-ibearing. administra-r 

\tor^.\. through a combined in-serViqe internship and the scientific study 

• - ■ ■ . ■ * s ' r ' • - . • - 

of; adgnnistration; (3) simulation games of yar/ financial investment, 
and firm school administration; (4) a course relating racial and eth- 
nic relations to sensitivity training; (5) the use of dir^ected field 
\study in an urban sociology or cultural' anthropology course;/ (6) pas- 
toral cofffteling for the ministry to the- recidivist criminal, the drug 
addict, the homosexual and the normal per^onT The intersect theory, > 
sciencei and praxis is the heart of Type I I.I interdisciplinary courses. 

The Crux of Evaluation: ' ^ 



How does one assign value or merit to a student* s achievy^- 



ment? . How dpes one as's^ign value or :inerit to a' particulajj course or 



i0s- ' 



son? Hov does one assign value or merit to.a, particylar instructor^ ^ ' 
And to these classfc, questions wKfch were posed at th 2 'outset of this 




paper, one must add another. How does one assign value or merit within-^ 
an interdisciplinary course cont^t? These practical questions require 
answers at this timel ■ , 

' / ' ^ ^ ■ ' - ' ' • ^ ■ 

TRe answer^to these questions rests in the instructor ex- 
plicitly defining b^tiavioral objectives (sometimes called "terminal 
behaviors") for shaping and optimising student^ achievement. For when^ 
the particular. learnings are known and stated in explicit behavior^il 
terms by the instructor, he then "shows-and-tells'^them. Using v|,riou 
instructional formats, the student knows which particular behaviors are 
'to be Iparned through the course. Regardless of type of course or levef 
of instruction, b§havi orally defined objectives dict^t^ the types of 
materials and the range of appropriate instructional foi-mats so that the 
student/s achievement can be obtained optimally. ^ . 

• Behaviorally defined instructional goals make it possible 
f^or the orthogonal />model of evaluation to work. - Behavioral ly defined 
objectives provide criteria for estimating and meriting student achieve- 
ment, mr determining the adequacy and appropriatene%| of elements in the 
curjficular des-ign, and for meriting instructional skill jn fair and ob- 
jectifying ways* Jhe efficacy bf results in the induction of the speci- 
fied terminal behavior in the studenl; as intended by- instructional jn- 
tent "and strategy is the crux of evaluation. Regardless of type or level 
of course J a rather comprehensive specification or inventory of behavioral 
ly deVineJ cours-e objectives becomes tho Oci^ham' razor for meriting fairly 
^ and objectively student achievement, adequacy and appropriateness of Qur- 



riculum desf^'n, and ins trUctidi:ial\. skill . 



Beh aviorally Defined Objectives ; 

There is a small classic autotutor text by Robert F. Magerw , 

/ f ^ 0 . : .... ^. / 

titled Preparing IristructioncH . Objectives^ which should be- tn the library 
of every instructors especi^lf^ at the college'and university leveV. He 
provides a practical definition -and useful guidance in the pregaTcition 
of behavioral objectives.^ Hi ^ lead Vs followed here. For emphasis, the 



imperative. mood is used. 



(1') Write one' statement of instructional objectives which is 
a description of your educational intents for the student, 

(2) In yoyr statement of instructional objectives, describe 
what the student will be doling when he demonstrates Kis achievement 

. ? to you.. ' ' f ' 

(3) In your statement of instructional objectives, describe 
how you will know the student's accomplishment when he is demon- 

. strating/ it to you. 

(4) Describe the student's terminal behavior (or 'what the 
styden^ will be doing) in the following manner: (a) identify in* 
actional verbs and name the overall behaviorally defined act;, (b) 
'defi nel the conditions under which the behavior to occur includ- 

\ ingthe givens and/or restrictions when required; (c) define the 
criterion of aQcept'able performance. ■ " ^ 

is) Write separate statements of l)bjectives for each be- 
haviorally defined act to be taught. The more such statements of 
-behavioral objectives per course, the better you- will have com- 
municated to the student your instructional intents for him. 

(6) ^Provide every student in your course with the -list of 
behaviorally defined instructional objectives prior -to teeing 

the course. * . ^ 

Q - ■ " . ■ . ^■ 

For purposes of illustration, permit the introduction of the following. 
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The illustration provided ^e.low is an interdisciplinary 

social scieoce course for* independent study of the Type JI I .variety. 

.. . ' /■ ■• . ■ ^ / 

The course is titled "Personal Values Analysis." /For brevity, 'only one 
behavioral objective is^given, 

/ ^ COURS& ilO> 199: Independent StudV-"Persona1 Values Analysis; 




^ One goal of "^his" independent s^dy course is for the student 
to 1)erform rational reflective value analysis in several areas of 
his personal commitmentsx Student perforrtiance of rational reflec- 
tive v,alue analysis fs to be demon5trate<t^d evaluated in the fol- 
lowing Ifi^nner. ^ \ , . 



(1) In any area of his most personal .concern and i.rit^rest, 
the student is to list Mn order of merit hi^ preferences. Example : 
Musi c--- (a hard rock"; (b) "dixieland"; (c) "Blires". . ^"Tn^j 
"Bach." ; . , , 

(2) , The student is to delineate the similarities and the con- 
.trasts between the *"most merited" and the "least merited" in his 
hierarchy of preferences. Example : "hard rock" vs^. "Bach." 

(3) The student is to construct the general valuing princi- 
ple which orders his intuitive hierarchy of * preferences for his' se- 
lected field. Example :. A Dionysian to Apollonian music preference 
scale, wilJh high preference at the Dionysian ehd. 

. (4)^The student is to. write his full value analysis in essay 
form at a two hour sitting ^with any notes and/or other materials he 
may need for the task. , 

(5) Full student performance in rational reflective value 
analysis is demonstrated (given the student's own selected value 
area) if the student's essay contains the appropriate substantive 
data for the analysis- and the student has u^ed explicitly the* full 
rationale given above in itemsl, 2, and 3.. ^ , 



Of the- six imperative descriptive statements on the nature of behavioralTy 
defined ^objective^r the first four wereMl lustra ted in Course 199^ii per- 
sohal values analysis* The >nstructional intent cf Course 199 to. teach 
rational reflective vclues analysis is given, the process being described 
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and illustrated by example, and *a criterion for performamce evaluation is 

■' . ' V r ^ ■ ■■ • 

provided. ^ <> , 

It is readily observable that such ar- behavioral ly defined 
objective as that given' in Course 199 certainly fashions the instructlortal 
'materials and strategiejs to be used so that the student can achieve the 
'specified performance task. Certainly the-student is directed explicitly 
to both a proce&s of pers9nal value analysis and to an egorinvolved pro-^^ 
duct produced thereby. The expTic>tness of the performance conditions 

and criteria demonstrates to instructor and student alike 1;heir compe- 

. ' . - ^' - • • / ' 

tence in the instruction and in the learning of the specified task, re- 

• i . . - 1 , 

spectively/ This behaviora"^ defined objective jnakes jthe orthogonal 
model of educational evaluation work fairly and objectively and with sal- 
utary cybernetic effect on bath studen^ and instructor. Fortunately, 
there are several college and .university level ' taxonomies of objective^ 
in the cognitive, affective, psychomotor and social domains' that are ex- 
cellent guides for instructors. They are: (1 T Bloom's Taxonomy of Ed^ 
ucationaT Objectives. . .Cognitive Domain ;^ (2) Kraihwohl 's Taxonomy 
of ^ucationai Objectives,^ .Affective Domain ;^. (3) Harrow's A Taxon- 
omy of the Psychomo^r Domaifj ;^ (4) Havighurst's Developmental Tasks and ' 
. Education . T^ese taxonomjA^ are necessary tqpls for every college and 
university instructor so that he need not re-invent tHe wheel. But in- 
structors will need a.1 ways to rely upon their creativity ^and ingenuity to 



write appropriate bfehavioraJ objectives to meet the needs of their indi- 

6 . • / 

vidual students. , ^ ' . 



iumme Edudgtion; 



M < ■ 



As social and behavior'al scientists, we are"' commi tted to 
good science and'to good educatid>n. A'nd, are committed to the .use of 
the best products of bur^^collfeetive labors in these'Jnterests. Certainly, 
the 'USE of behavioral ly defiried objectives moves our students from a 
state of dependency upon the Instructor to a state of independency from 
him. Certainly, the valuing of -^tudent achievement, curricular design, 
and .instructional skill through behaviorally defined objectives is pro- 
ductive of faij, objective* and cybernetic type evidence-that is phenome- 
nally empirical and humane in i%act; This writer hopes that behaviorally 
defined objectives will p'lay a larger part in the adventures in humane 
education for both the student and the instructor. 



4. 
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* ^.FOOTNOTES 



- • « iKapru Yamamoto, "Many Faces of Teaching," in Teaching : 

^- ■ ■ / ■ . ' ■ . ■ .■ 

■' ' •' . • • ■" ■ ■ ' / 

ESj^ays and Readings , edited by Kaoru ^Yamamoto (Bpston: Houghton -Miff! in 

■ ■ • 

Company ;^*^9), pp. 3-16-^ 

» - - ■ . . ■ ■ ' ' ■ 

p ^This section is substantively from; James Steve Counelis, 

V "What is an Interdisciplinary Course in the SociaL Sciences?", Communitly 

^ College Social Science Quarterly ; (In press). 

: %hese KuUurgesctjichte works are: (1) Jacob Burckhardt.l 
The. Civjilization of the Renajssetyice in Italy: An Essay (Qxford: Phailtfdn 
, Press, iltd., 1945); (Z) J. /Huizinga. The Wanfng-of the Middle Ages: h^' 
Study m the Forms of Life, Thought, and Art in France and theN^ether- 
lands 'inl the XlVth and XVth Centuries (London: Edward Arnold and Co. , 
1924); (3) William H. McNeill, The Rise of the West: a"> History of the 
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